United States Patent [19] 

Phaal 



in 



US006055564A 
[ii] Patent Number: 
[45] Date of Patent: 



6,055,564 
Apr. 25, 2000 



5,889,951 3/1999 LombaTdi 709/219 



[54] ADMISSION CONTROL WHERE PRIORITY 
INDICATOR IS USED TO DISCRIMINATE 
BETWEEN MESSAGES 

[75] Inventor: Peter PhaaJ, San Francisco, Calif. 

[73] Assignee: Hewlett Packard Company, Palo Alto, 
Calif. 

[21] AppL No.: 09/038,657 
[22] Filed: Mar. 11, 1998 

[51] Int. CI. 7 G06F 15/16 

[52] U.S. CI 709/207; 709/217 

[58] Field of Search 709/207, 217, 

709/219, 223, 224, 239 

[56] References Cited 

U.S. PATENT DOCUMENTS 

5,006,978 4/1991 Neches 709/102 

5,218,676 6/1993 Ben-Ayed et al 709/240 

5,377,354 12/1994 Scannell et al 709/103 

5,481,312 1/1996 Cash et al 348/845.2 

5,617,541 4/1997 Albanese et al 709/207 

5,623,603 4/1997 Jiang et al 709/207 

5,699,521 12/1997 lizuka et al 709/207 

5,799,002 8/1998 Krishnan 370/234 

5,826,031 10/1998 Nielsen 709/207 



Primary Examiner — Zarni Maung 
Attorney, Agent, or Firm — Marc P. Schuyler 

[57] ABSTRACT 

This disclosure provides for admission control with multiple 
classes of service and priority processing. An admission 
control system preferably admits incoming messages which 
are part of a session-in progress. As to messages represent- 
ing new sessions, the admission control system admits such 
messages on the basis of priority or class assigned to them, 
or otherwise discriminates between messages stored in a 
message queue based on priority. In a preferred 
embodiment, if server resources become strained, the admis- 
sion control system can defer messages in order of lowest 
priority or if allocated class resources have been exceeded. 
In one embodiment, messages are assigned different status 
for two web site providers paying for different levels of 
service available, such that as server resources become 
stretched, one web site will receive better quality of service 
than the second web site. For deferred messages, the server- 
based system determines when priority access can later be 
provided to the particular client and transmits to the client an 
indication of that time. One example uses a downloaded web 
page to automatically cause a client browser to later auto- 
matically access the host on a priority basis. 

19 Claims, 3 Drawing Sheets 
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ADMISSION CONTROL WHERE PRIORITY and typically offer no guarantee for completion of sessions. 

INDICATOR IS USED TO DISCRIMINATE Also, messages which are not admitted to the host are 

BETWEEN MESSAGES typically not handled at all, such that a client is not informed 

that the request has been refused or the client, if informed, 

The present invention relates to communications 5 ^ simply asked to "try again later/' A refused client must 

between computers and, more particularly, to enhancing USU ally try repeatedly to obtain service with no guarantee 

service in applications where one computer receives and mat future requests will be processed 

processes messages from other computers. Adefmite need ^ for & hQst processing system which 

BACKGROUND can prioritize messages, either based on function or context. 

Several protocols exist in which one computer (a "host") 10 With such a s y stem > a host implement different types 

receives and processes messages from a number of other of service for different functions, for example, different 

computers ("clients"). For example, in applications involv- processing tasks or different destinations such as web sites, 

ing the world-wide web, a server can receive and process Additionally, a need exists for an improved host processing 

many concurrent messages from different personal computer svstem which can improve quality of service by admitting 

users; in this example, the server would be the "host" while 15 entire sessions, deferring entire sessions, and prioritize han- 

each personal computer would be a "client." dlin g of deferred sessions when they are re-submitted. With 

Many of these protocols are referred to as "stateless," a s ^ em °* l ™*> admissi u on cont [° 1 would ? l 

meaning that a host inherently processes each message P™ lde a rehable m A eans ° f each f 55100 wth ^ 

without regard to any particular client or past messages 9n ^ of serv ^ ***** .toth^ exists for a system that 

which have been transmitted between host and client. 20 P™ vide u s some level ° f s ™ to a11 cl ™ i& > ^eluding those 

Examples of stateless protocols include Hypertext Transfer « have be& ° refu f d admission Ihe present invention 

Protocol ("HTTP"), Internet Protocol, User Datagram solves these needs and provides further, related advantages. 

Protocol, Simple Mail Transfer Protocol, and Network File SUMMARY 

System Protocol. As implied by this description, typical ^ 

stateless protocols inherently treat all messages as the same, The present invention provides a host processing system 

processing them in the order received. having multiple classes of service. Using the present 

Frequently, however, there may be one or more functions invention, a host processing system can accord priority in 

which are considered relatively more important or urgent processing sessions which have been previously deferred, or 

than others. For example, in some applications involving the 30 which correspond to a web site or processing task that is 

world-wide web (the "web"), it might be considered more considered more important that other functions of the same 

important to receive and process a commercial transaction host processing system. The present invention thus permits 

than to permit browsing of certain types of information. allocation of processing resources during times of stress to 

Functions can also be considered relatively more important be concentrated on those functions are considered to have 

or urgent dependent on context; for example, as host pro- 35 priority. The preferred host processing system is also 

cessing resources become stretched, a user of a client system session-based, such that once a message is admitted, all 

may become more frustrated in trying to access information related messages are processed on a priority basis. By 

or complete a transaction. Such a user may submit a request facilitating quick completion of admitted sessions, and pro- 

several times if an inadequate response is received, height- viding an effective mechanism for handling deferred clients, 

ening frustration, and it may be desired to give such users ^ the present invention provides a low-cost mechanism for 

priority in host processing. significantly enhancing service in host processing 

One technique which has evolved in connection with applications, such as involving the web. 
reducing user frustration involves applying "admission One form of the invention provides a host processing 
control," where only a certain number of client messages are system which allocates incoming messages according to an 
processed ("admitted") and the remainder are refused; of the 45 indicator of priority or class ("priority indicator") associated 
messages which are in fact admitted, all are ideally handled with each message; the indicator can be assigned by a host, 
in an expedient manner without degradation of quality of by an admission control system, by the client itself, or by the 
service as to those admitted messages. An advantage of this message's ultimate destination. In this form of the invention, 
technique is that admission control can be implemented in messages having a relatively high associated level of priority 
software, thus facilitating quick, inexpensive use with little 50 received favored treatment over messages having lower 
advance notice. Unfortunately, typical admission control priority. For example, messages in a queue can be reordered 
mechanisms operate by admitting messages on a message- according to priority. Messages can also be, when host 
by-message basis and, so, these typical admission control processing resources become scarce, admitted or rejected 
messages do not provide an adequate solution for multiple- based upon priority. The indicator can be a specific alpha- 
message sessions. The fact that messages are stateless to a 55 numeric field associated with each message, and it can also 
host does not imply that each message sent by a client be in the form of presence or absence of a specific field 
system is independent of other messages sent by the client (indicating a priority and non-priority, respectively), 
system, and it does little to relieve user frustration if one a second form of the invention provides for a host 
message in a series of related messages is admitted, while processing system having admission control, using an 
the others are delayed or refused admission. 60 admission control gateway and a resource monitor which 

Thus, admission control generally provides a way to regulates messages processed by a host. When the admission 

prioritize messages which are received first; as long as control gateway receives a message that calls for a new 

processing resources are available, received messages are client session, the gateway uses the resource monitor to help 

processed. As soon as processing resources become scarce, determine whether a processing threshold has been reached; 

however, messages are refused admission to the host. 65 if the threshold has been reached or surpassed, the message 

Admission control typically does not provide a means of is checked to determine if a new session represented by the 

discriminating between different functions offered by a host, message is to receive priority. 
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In more detailed features of this second form of the enumerated claims, but to serve as a particular example 

invention, admission control can be used to interrupt one or thereof. The particular example set out below is the pre- 

more sessions of lower priority (or from an over-represented ferred specific implementation of a host processing system, 

class) and defer them, making room for processing of the namely, one which provides priority access based on mul- 

session of higher priority. Deferred messages can also be 5 tiple classes of service, deferral of certain messages, and a 

specially handled; for example, deferred messages can be web page downloaded to a client having automatic or 

passed to a deferral manager to formulate a response to the elective attempts to later attain access. The invention, 

particular client. A scheduler can then be checked to deter- however, may also be applied to other types of systems as 

mine a time when the host can expect to have processing well. 

resources available, and the deferral manager responsively 10 j Introduction to the Principal Parts 
formulates a time indication which tells a client system 

when it can expect to gain admission to the host. At the same The preferred embodiment is a host processing system 
time, the deferral manager can increase the priority of the which allocates incoming messages to one or more process- 
deferred message, such that on the next submission, the m g tasks according to priority or class of service (each 
message will be accorded a higher priority status. In one 15 referred to as "priority"). "Priority" is preferably associated 
embodiment, the admission control gateway can assign with eacn message by an admission control system, by a 
more than two levels of priority, such that messages deferred message itself, by a client system or by the server. The term 
twice are accorded higher priority than messages deferred "priority" includes situations where a specific indicator of 
once and so on. c ^ ass k embedded in packet information for each message, 

Using a priority indicator (or lack thereof) associated with 20 or a client cookie, as well as situations where some messages 

each message, the present invention provides a mechanism have no field (e.g., indicating a lack of 

for sorting messages according to priority and treating them P n ° n ' v relatlve }° other s P eclflc 1 messages). In one preferred 

,. ff t1 u *u u .^a u a. 7: embodiment, admission control can be used to assign pn- 

dinerentiy, whether based on host processing lunction or . 7 , , fT r 

nrior deferral ont ^ t0 a messa S e ^ receive d depending upon the ultimate 

_ . t t , , , e . 75 destination of the message, for example, a particular web 

The invention may be better understood by referring to sh( . In mo(ke[ {f . Ited embodim6nt> priorily can be 

the following detailed description, which should be read in ^ d t0 messages u on defcrral (because me server is 

conjunction with the accompanying drawings. The detailed t0Q b t0 handk Q6W sessi(jns re ented by me 

description of a particular preferred embodiment, set out messages) such mat when later re . submit ted, the messages 

below to enable :one to build and use one particular imple- are then . handlcd on a priority basis . In mis latter 

mentation of the invention, is not intended to limit the emhodiment, deferred messages can be specifically assigned 

enumerated claims, but to serve as a particular example m appoimmen , for re . submi ssion at a time when it is 

1 * thought that the server can guarantee priority processing to 

BRIEF DESCRIPTION OF THE DRAWINGS the message. In this latter embodiment, admission control is 

35 used to format a message response to the client, to inform the 

FIG. 1 is a block diagram showing implementation of client's user that access has been deferred, and to accord the 

multiple classes of service, including allocation of messages client a means of later obtaining access on a priority basis if 

according to priority (including message queue reordering), the client contacts the host processing system again at the 

determination of whether a message corresponds to a session proper time. Finally, priority can be used to re-assign order 

in-progress, and allocation of new sessions for messages not 40 °f messages in a message queue, such that messages receiv- 

corresponding to a session in-progress. Message queue ing priority are always processed very quickly, 

reordering presents an optional feature and, so, is indicated Of the aforementioned embodiments, the preferred 

in dashed lines in FIG. 1. embodiment which will be primarily discussed below is a 

FIG. 2 is a block diagram showing a host processing host processing system which includes admission control 

system and preferred use of admission control which imple- 45 functions. That is to say, the preferred embodiment includes 

ments principles indicated in FIG. 1. In particular, FIG. 2 at an admission control system that normally admits and 

its left shows a plurality of clients which may communicate rejects messages from a client system to a server, but if 

with a host processing system, seen at the right side of FIG. processing resources of the server are strained, the admis- 

2. sion control system admits messages based on priority. At 

FIG. 3 is a block diagram that indicates operation of an 5 ° client system, a user is preferably afforded a means of 

admission control gateway, seen in FIG. 2. automatically contacting the server again, once the 

i-i- ? appointed time has been reached. In the preferred 

FIG 4 is a block diagram that indicates operation of a embodiment? admissi on control software operates princi- 

deferral manager, seen m FIG. 2. paUy Qn a and formats a wd? page which jg 

FIG. 5 is a flow diagram which indicates operation of a 5S downloaded to the client as part of a deferral message. This 

block 500 of FIG. 3, namely, a portion of the preferred special web page provides a countdown function, visible to 

admission control gateway which processes or defers new me client's user, which indicates time until re-submission in 

sessions based on assigned class of service. minutes or seconds; if the client closes the browser or uses 

it to contact a different web page, the web page is disabled 
60 and the client will not automatically contact the server (in 

The invention summarized above and defined by the the preferred embodiment). This implementation is 

enumerated claims may be better understood by referring to preferred, because it can be implemented entirely in soft- 

the following detailed description, which should be read in ware on the server side (including formation of the special 

conjunction with the accompanying drawings. This detailed web page which is downloaded to the client), 

description of a particular preferred embodiment, set out 65 FIG. 1 illustrates general processing of incoming mes- 

below to enable one to build and use one particular imple- sages applied by a preferred host processing system 11. In 

mentation of the invention, is not intended to limit the particular, messages from a stream of incoming messages 13 
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are interrogated to determine whether or not they represent 
a session in-progress, and messages conespondmg to ses- 
sions in-progress are admitted to the server, as represented 
by decision block 15 and function block 19. Sessions 
in-progress are verified by comparing packet information for 5 
a particular message with a list of sessions in-progress 
(including client and server identification) which is stored in 
a buffer 16 by the admission control system. For messages 
not corresponding to sessions in-progress, the host process- 
ing system determines priority of the messages, and alio- 10 
cates new sessions and corresponding messages 22 accord- 
ing to priority (as indicated by function blocks 21 and 27, 
respectively). In FIG. 1, the reference numeral 23 is used to 
designate messages and sessions having a relatively higher 
priority, and the reference numeral 24 is used to designate 15 
messages and sessions having a relatively lower priority. 

As indicated earlier, messages may receive different pri- 
ority based on final destination, for example, two different 
web sites 17 and 18. In such an embodiment, each web site 
can be assigned a specific percentage of processing 2 o 
resources, for example, in a seventy percent/thirty percent 
split. Different priorities can also be assigned to a single 
processing task or destination, such that the server admits 
messages with higher priority 25 at the expense of lower 
priority messages 26. In the case of resources split between 25 
two web sites, a new session can be admitted for a web site 
not using its full resource allocation at the expense of a 
second web site using more than its allocated share. "Pri- 
ority" may also be optionally used to speed up certain 
functions of the host processing system relative to others, by 30 
reordering messages in a message queue according to pri- 
ority and passing the messages having highest priority to a 
server for processing, as indicated by phantom blocks 28 and 
30, respectively. As an example of this latter function, the 
admission control system can specifically look at a mes- 35 
sage's packet information (or look at a client cookie) and 
reorder messages based on client identity, ultimate 
destination, or a priority indicator field associated with the 
message. 

FIG. 2 shows a block diagram showing additional detail 40 
regarding a preferred host processing system 111. In 
particular, the diagram illustrates a hypothetical connection 
between a client side 113 and a host side 115. The host side 
includes one or more servers 117 and 118, each of which 
may have one or more web sites. Notably, it is common to 45 
find configurations where several servers are arranged in 
parallel to share processing responsibility for a single web 
site (such as a "round-robin" configuration), but for the 
subsequent discussion it will be assumed that only one 
server is present; the present invention can be implemented so 
on multiple-server systems as well. The client side 113 may 
include many individual personal computers 119, which 
may each contact the host side 115 via a complicated 
network of communications paths and nodes. Irrespective of 
the particular communication path, the host side 115 55 
receives a stream of incoming messages 121 which may 
access one or more web sites stored on the server 117 or 118, 
and provides a stream of outgoing response messages 123 in 
response. 

Admission control is effected by passing the incoming 60 
messages 121 to an admission control gateway 125, which 
determines whether to admit the messages to the server 117. 
Messages corresponding to sessions in-progress are prefer- 
ably always admitted, such that the user of a client can 
reliably expect a transaction with a server, once initiated, 65 
will be completed. It is believed that ensuring completion of 
sessions in-progress will promote less user frustration, e.g., 
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commercial transactions over the web, once begun, will be 
reliably completed to satisfaction of the user. At the same 
time, rather than stretch processing resources of the server, 
if too many new messages are received, the admission 
control mechanism preferably defers at least some amount 
of those messages, such that sessions in-progress can be 
reliably and quickly completed through the use of 
un-stretched server resources. A mechanism for responding 
to deferred clients preferably includes an affirmative state- 
ment about admittance, e.g., that the client will later be 
admitted at a time specific, to avoid too much frustration on 
the part of users of deferred clients. 

The admission control system of the preferred embodi- 
ment includes a resource monitor 127, which provides 
information on current use of server resources. The resource 
monitor is typically a set of code that uses a standard call 
function provided by most server protocols; the call function 
returns a value having a particular format, depending upon 
the server. For example, some servers will return a 
percentage, indicating present resources which are 
"occupied," while other servers may return an numeric value 
which is not based on a decimal scale (e.g., not a number 
from one to ten or one to one-hundred). 

A message received by the admission control gateway 125 
is first analyzed to determine whether it corresponds to a 
session in-progress. If a session has already been established 
(and the newly-received message is a part of a continuing 
transaction between the server and a particular client), then 
the message is preferably always admitted to the server. If 
not, the resource monitor 127 can be used to determine 
whether the message is to be admitted as the start of a new 
session. To this effect, the resource monitor 127 is coupled 
to a set of oue or more parameters 129 which are stored in 
a buffer. These parameters define a desired maximum load 
(or threshold for deferral) which may be static or may vary, 
depending upon the embodiment of admission control. For 
example, one embodiment uses reserved time slots which 
can be allocated to deferred messages; if a large volume of 
deferred messages are scheduled for processing on a priority 
basis at three O'clock, a stored parameter can be set for three 
O'clock to define a lower threshold, such that more mes- 
sages (which are non-priority messages) are deferred than 
normal at that time. In the preferred embodiment, a static 
figure is used (e.g., eighty percent), primarily for simplicity 
in implementation. The admission control gateway 125 
compares the set of at least one parameter with the result of 
the call function and, if the comparison indicates that server 
processing resources have exceeded the threshold, then new 
sessions not having priority are deferred. 

Since the admission control gateway 125 defers some 
messages corresponding to new sessions when resources are 
stretched, it is desired to provide some reply to a client 
system which submitted the message, in order that the user 
of the client system will not become frustrated or continually 
re-submit the message (thereby further overloading server 
resources). To accomplish this end, the admission control 
system 111 further includes a deferral manager 131, which 
formats and provides a response message 133 to the client 
system which submitted the deferred message. Preferably, 
the deferral manager 131 is coupled to a scheduler 135 
which, together with the deferral manager, calculates a later 
time when it can be expected that the deferred message can 
be processed by the server 117. The scheduler has many 
possible implementations for obtaining such information. 
For example, the scheduler can compile statistics based on 
day-to-day operation of the server and times when the 
processing resources of the server tend to be less strained; in 
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this example, the scheduler could determine that a particular implementation of the preferred embodiment will now be 

server is "less busy" from twelve O'clock noon until one further described. 
O'clock P.M., and could defer a client system until twelve 

O'clock noon and the one hour time range thereafter. n. Server Side Admission Control 

Alternatively, the scheduler could simply set "appoint- 5 __ - , A . t .„ 4 A . c . 

ments" (e.g., two for every five minutes) and simply return / IGS 3 and f are L used t0 illustrate operation of the 

to the deferral manager 131 a time for the next available admission control on the server side in additional detail. In 

appointment. In the preferred embodiment, the scheduler particular, FIG. 3 shows additional detail for the operation of 

uses the latter function and defers messages for a minimum me admission control gateway 125, whereas FIG. 4 shows 

predetermined amount of time, e.g., 300 seconds as indi- additional detail regarding the operation of the deferral 

cated by Table I, below; in conjunction with a time set by a manager 131. 

web page which is downloaded to the client, the client's As seen in FIG. 3, the admission control gateway 125 

message is later accepted on a priority basis if the client processes each next message 137 in the stream by either 

contacts the server within a defined interval following the sending the message to host processing (e.g., to the server), 

time. Implementation of the scheduler is effected in the ^ indicated by the reference numerals 138, 139 and 140, or 

preferred embodiment via software. 15 by <x n6ing me message to the deferral manager, as indicated 

A number of mechanisms can also be implemented such by th e reference numeral 141 

that the admission control system 111 recognizes a deferred ^ admission CODtrol t fins < j^ga^ each 

message as a priority message following re-submission. In 4 j4 , ~. 4 / ■ * * 

the preferred embodiment, the deferral manager 131 gener- messa g c to dctenmne w * eth f mcs ^ e \f™} 

ates a "key" in the form of a "cookie" which the admission 20 session in-progress, as indicated by a software block 143. 

control system writes to memory of the client system. When Sey ^ al dlfl fe rCnt ° f da }* ca " be U f td pUrp0S< \' 

access is again requested by the client system, the admission «* indicated by a data block 145. First, the admission control 

control gateway 125 interrogates the client system to deter- gateway can maintain a transaction list which includes 

mine whether the cookie is present and, if so, the admission information on the requesting client and the session at-issue; 

control gateway accords priority status to a message from 25 tne a^issi 011 control gateway monitors header information 

the client system at that time, in terms of generating a new f° r eacn message and simply determines whether informa- 

session. In addition to writing the cookie to the client tion corresponds to a list of sessions in-progress. Second, the 

system, the deferral manager 131 also generates an infor- admission control gateway can simply look for a particular 

mative web page which it downloads to the client's browser. password or identifier provided with the packet information 

This web page visually displays to a user of the client system 30 for tne message. Third, the admission control gateway can 

an informative text message, e.g., ^0 f° r a client cookie which has been written to the 

"We're sorry, but our server is 'temporarily serving other requesting client, by simply interrogating the client via a 

clients; to better assist you, we have scheduled an response message to determine whether the cookie is 

appointment for your transaction, and if you do not exit of these Processes, a transaction list is preferably 

this web page, your browser will automatically contact 35 used as the most expedient of these processes, 

us in 23 seconds." F° r sessions which are in progress, the admission control 

The numeric figure in the above text message is a countdown gateway 125 applies criteria to limit overall session length 

time, and the web page generated by the deferral manager (as represented by reference numeral 144 in FIG. 2), so as 

automatically establishes a countdown mechanism on the to ensure that all sessions are terminated as of some point in 

client system. The countdown time is continually displayed 40 time. For example, as seen in Table I (below), session length 

to a user, and once the time reaches zero, the web page may be capped to 1800 seconds, with the admission control 

automatically directs the browser to the same URL which gateway invalidating any session which exceeds that length 

resulted in the deferral, and the admission control gateway of time, as designated by the reference numeral 146. When 

125 checks for the presence of the aforementioned cookie. sessions are admitted, they are assigned to a class, and the 

Certain alternative implementations are also possible, 45 class identifier is included in a cookie stored on the associ- 

such as where a web page is not used; these embodiments &ted client system. The server or admission control system 

include systems where the browser is a modified browser on keeps statistics for each request processed, for example, 

the client side, which includes a buffer (not visible to the statistics on the last 1000 requests (for each class, if multiple 

client's user) for storing a uniform resource locator ("URL") classes of priority are used). Typically, a server will not need 

of a server which has deferred access, together with an 50 to terminate sessions, but it (via the admission control 

appointment time. The modified browser is effective to (in system) will simply stop admitting sessions in an over- 

the "background" as far as concerns the user) automatically represented class and allow natural attrition to reduce its 

detect when the appointed time has been reached and then population. If this does not occur quickly enough then 

cause the browser to submit a priority message for process- sessions are terminated by invalidating their session cookie, 

ing by the client. Ideally, the user is afforded in this 55 In each case where a cookie is used, alternative state 

embodiment an election at some point during the process, as tracking mechanisms can be used. The server could have a 

to whether the user wishes to establish deferred access. The table of the states of the current sessions and simply update 

browser is then directed to automatically open up a separate or read entries from that table. Sessions which have not been 

window for each new session initialized via the buffer. in-progress for an excessive length of time are passed along 

Ideally also, the buffer of the modified browser can store so for processing, as indicated by the block 138. 

indications for several deferred, priority sessions, and the If the message is not part of a transaction in-progress, the 

modified browser is effective to order such indications such admission control gateway 125 can also admit the message 

that they are used to establish deferred sessions at the proper as a new session if it is determined that the server has 

times, regardless of the order in which the indications are sufficient processing resources available, as determined by 

received. 65 comparison with the set of parameters 129 (the determina- 

With the principle features of the preferred embodiment tion is indicated in FIG. 3 by the reference numeral 147). 

(and some of the alternative embodiments) introduced, The admission control gateway 125 can further admit the 
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message if it is determined that the message corresponds to 
a message which has been previously deferred, as indicated 
by a decision block 149. In this regard, these two determi- 
nations can be performed in alternative order depending 
upon the particular implementation. For example, in an 
embodiment where reserved time slots are used and dynamic 
parameters 129 are used to regulate un-reserved (or 
contention) time slots, it is preferable to detect new sessions 
having reserved time slots so as to not reduce the number of 
contention slots available. In the preferred embodiment, 
specific slots are not used and the parameters 129 include a 
single, static threshold, with lowest priority (e.g., most 
recently received, non-priority) messages being deferred, 
even if already in-progress, if the server only has processing 
resources for priority messages. Consequently, the determi- 
nations can equivalently be performed in the preferred 
embodiment in the order indicated in FIG. 3. Notably, 
processing using priority classes is identified as a processing 
block by the reference numeral 500, and will be discussed 
further below. If the determinations do not result in admis- 
sion of the message to the server, then the message is sent 
to the deferral manager, as indicated by the bottom most 
block 141 of FIG. 3. 

The operation of the deferral manager 131 is indicated in 
FIG. 4, and results in the sending of a deferral message to the 
client system, and the creation of a priority identifier that 
permits re -submission of the deferred message on a priority 
basis. In the preferred embodiment, the deferral manager 
operates in communication with the scheduler 135 to deter- 
mine a time when future processing resources of the server 
will be available on a priority basis for deferred messages (as 
indicated by a functional block 151 of FIG. 4). The code 
which implements the deferral manager then proceeds to 
calculate a priority ranking for the deferred message, as 
indicated by block 153 of FIG. 4. Only two classes of service 
are needed by the preferred embodiment, namely, for prior- 
ity messages and for messages not having priority status, 
with additional distinctions made based upon newest session 
(i.e., a priority message representing the most recently 
commenced priority session is viewed as less important than 
priority sessions in-progress, and a non-priority message 
corresponding to the most recently commenced non-priority 
session is viewed as less important than other non-priority 
sessions in-progress). As a consequence, block 153 operates 
in the preferred embodiment by simply ascribing priority to 
any deferred message. 

Importantly, in one preferred embodiment, a number of 
classes of service can be made available for messages and 
different web sites, each having different class or priority 
ranking (1 to n). For example, if a server is used to support 
the web sites of two companies, and one company pays a 
premium fee for support of a first web site, then messages 
directed to the first web site can be given priority when the 
server's overall processes are strained, priority including 
preferred access at the expense of messages directed to the 
second web site. Alternatively, if processing resources 
become very stretched, it is possible that a server could at a 
particular point in time be processing only priority 
messages, in which case a message representing new session 
could in some embodiments be deferred twice; using mul- 
tiple classes of service, the twice -deferred message could 
receive a second step upward in priority, and so on. 

The deferral manager 131 then proceeds with the optional 
step of synchronizing host time with client time (indicated 
by block 155). This process can be as simple as calculating 
a countdown time in seconds and downloading that infor- 
mation to the client system (as is done in the preferred 
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embodiment), or in alternative implementations, the deferral 
manager can interrogate the client system to determine 
differences in time, and adjust the time indicator sent to the 
client accordingly. As indicated by block 157 of FIG. 3, the 

5 deferral manager 131 formats an informative message 
including the time indicator and sends this information to the 
client system, preferably including a message having a 
purpose to avoid user frustration (e.g., a message indicating 
that the client's request will be processed at a specific time, 

10 with automatic re -submission by the client's web browser). 
Preferably, the informative message is contained within a 
deferral web page which stores the URL of the server for 
which deferral occurred, and the deferral web page again 

15 submits the same URL at expiration of a countdown time. 

The deferral manager 131 also stores an identifier of 
priority status for each deferred message, via one of two 
alternative mechanisms (each indicated by dashed lines in 
FIG. 3). First, the identifier can be formatted as a "key" such 

20 as a password or cookie written to a hard drive of the client 
system (indicated by reference numeral 159) which identi- 
fies priority status. Alternatively, the deferral manager can 
(as indicated by block 161 of FIG. 3) write the identifier into 
memory on the server side of the admission control system, 

25 as part of a list. Use of a cookie is preferred, since such an 
implementation minimizes the amount of processing time 
required of the deferral manager, hence provides for greater 
throughput in processing deferred messages if a large num- 
ber of deferrals are occurring. The cookie should include a 
unique identifier for the particular server (or web site), and 
it should also be time-limited; the cookie can either include 
the time indicator itself (i.e., a cookie which varies from 
message-to-message), or it could be a unique value that 

35 changes each day, for example. 

A. Scheduler Operations. 

The scheduler may operate in any of a number of ways in 
order to optimize server processing. Preferably, the user of 
a client system should not have to wait long prior to 
re -submission of a message and, consequently, the preferred 
embodiment allocates appointments up to a predetermined 
number of deferred sessions per minute, and assigns mes- 
sages as soon as possible after deferral. This predetermined 
number of sessions can be varied using a server side 
configuration screen [indicated in Table I, below]. The 
configuration screen also specifies an exclusion time during 
which is the minimum amount of time following deferral for 
a corresponding appointment, 

50 In an example indicated in Table I, below, the minimum 
time before an appointment is indicated to be 300 seconds, 
with a maximum number of deferred sessions indicates as 
ten sessions per minute. In this example, if a total of 22 
sessions were to be deferred at approximately 3:00 P.M. (and 

ss there was no backlog of deferred messages), the deferral 
manager 131 would provide priority to the first ten messages 
if they re-submitted their messages between 3:05 P.M. and 
3:06 P.M., the next ten message between 3:06 P.M. and 3:07 
P.M., and the final two messages between 3:07 P.M. and 3:08 

60 P.M. If another message received at 3:01 P.M. was to be 
deferred, the message would receive priority between 3:07 
P.M. and 3:08 P.M., together with the 21" and 22* messages 
referred to above. It the message were instead received at 
3:04 P.M. (instead of at 3:02 P.M.), the deferral manager and 

65 scheduler would assign priority to the message between 3:09 
P.M. and 3:10 P.M., even if there were no backlog of 
messages. 
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TABLE I 



(SAMPLE ADMISSION CONTROL CONFIGURATION SCREEN) 
[About j Index | Statistics] 

Web Flow Settings 

Admit Sessions: 

[ ] S hutdown in [600] seconds. 

[ ] A lways (disables dynamic admission control). 

[x] if Lead < [5.oo] 

End Sessions When: 

[ ] interval between requests > [600] seconds. 
[X] or, session duration > [1800] seconds. 
Respond to Rejected Sessions with: 

[ ] a redirect to [ ] (leave blank if no redirection required), 

and then if redirected request cannot be accepted or redirection is disabled, 
respond with: 

[X] Page [count_down.htm] 

[X] Allocate up to [10] sessions per minute. 

[ ] External 

and then exclude them for [300] seconds. 



As further indicated by Table I, the server side configu- 
ration screen provides for adjustment of maximum load 
prior to deferral, for admission control to be turned "off," 
and also permits a number of other options in controlling 
admission. 

III. Client Side Admission Control. 

Client side admission control is preferably achieved auto- 
matically by the admission control system, using the deferral 
manager to format and download to the client a web page 
that automatically redirects the client's browser back to the 
particular server when the proper time has been reached. 
Presently contemplated alternative implementations of cli- 
ent side admission control include: a pervasive program file, 
which launches either the client's web browser (if the 
client's browser has been such down) or an additional 
browser window (if the client's browser is active); and, a 
modified web browser which automatically stores several 
appointments for deferred server access. 

Additional details regarding applications using multiple 
classes of service are discussed in U.S. patent application 
Ser. No. 09/038,868, for "Admission Control Mechanism 
with Messages Admitted or Deferred for Re-submission at a 
Later lime on a Priority Basis," for inventor Peter Phaal, 
filed on the same date as this disclosure, which is hereby 
incorporated by reference in its entirety, as though set forth 
herein. 

IV. Use of Multiple Classes of Service. 

FIG. 5 respectively indicates operation of the admission 
control gateway 125 in the case of multiple classes of service 
and provides an expanded view of block 500 seen in FIG. 3. 
The admission control gateway first checks the priority "k" 
of a message, which can vary from one to "n." The first 
processing block 501 of FIG. 5 returns the value "k" for a 
determination of whether the server has resources available 
to process the message as a new session. 

The motivation for multiple classes can vary: for 
example, the admission control system can be designed to 
support multiple deferrals with a higher priority in admis- 
sion given to those messages deferred more than one (such 
that messages deferred twice would be given priority over 
messages deferred once). The multiple classes can also be 
designed to support one or more web sites, where perhaps 
one web site provider is paying for a premium service for 
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better service than another web site provider (or for the 
purpose of ensuring that multiple web site providers each are 
guaranteed a fair or allocated share of resources). 

Four decision functions 503, 504, 505 and 506 determine 

5 whether processing resources can be "made available" for a 
newly- received message having class "k." It will be recalled 
that a block discussed above in connection with FIG. 3 
determines whether processing resources are available and 
admits messages on that basis; consequently, when opera - 

10 tion of the admission control gateway reaches the block 503, 
it has already been determined that the server has already 
exceeded its maximum load, and that no more processing 
resources are available. Consequently, it is first determined 
via decision block 503 whether a class of lower priority can 

15 be bumped to make available a session corresponding to a 
new message. Notably, one alternative embodiment which 
could be readily implemented would result in use of two 
thresholds, e.g., where a new session is admitted at block 
503 instead of bumping sessions in-progress of lower 

20 priority, until a second threshold is reached (as per phantom 
block 502), The use of two thresholds in this manner permits 
temporarily exceeding a first threshold under the presump- 
tion that natural attrition among sessions will quickly reduce 
the number of sessions in-progress to again fall below the 

22 desired maximum load. 

Whether this latter embodiment is implemented, the sys- 
tem preferably supports multiple classes having assigned 
maximum resources (for example, to two or more different 
web sites), with priority being determined depending on 

30 whether a class has exceeded its resources. As seen with 
reference to decision block 504, it is determined whether a 
class associated with a new message has been assigned 
limited resources; if so, it is determined whether class "k" is 
under-represented in use of CPU resources. As indicated by 

35 decision block 505, if acceptance of a new session repre- 
sented by a current message would place class "k" beyond 
its allocated share of resources, then the new message is 
preferably immediately deferred, as indicated by function 
block 507. If session corresponding to a class of lower 

40 priority is in-progress, or if another class of limited 
resources has exceeds its allocated resources, then the sys- 
tem proceeds to determine whether a lower priority session 
can be bumped to make room for a new session, as indicated 
by decision blocks 503 and 506 and function blocks 511, 513 

45 and 515. If no room can be made for a new session, for 
example, because there is no session of lower priority and no 
class for which allocated resources have been exceeded, then 
the newly-received message is sent to the deferral manager, 
as indicated by function block 507. 

50 When bumping a session in-progress, the admission con- 
trol gateway identifies a lower priority session in-progress 
and interrupts that session, sending it to the deferral manager 
to make room for the new, higher priority message (as 
designated by numerals 511 and 513, respectively). The 

55 newly-received, higher priority message is then admitted to 
the system as indicated by function block 515, while the 
deferral manager formats a deferral message corresponding 
to the lowest priority message which was deferred, and 
assigns it a higher priority and a later appointment. 

eo Optionally, for messages which have been deferred, the 
embodiment of FIG. 5 can increase the priority of a message 
to "k+1" as indicated by a function block 509 seen at the 
bottom of FIG. 5. 

As can be seen by the foregoing description, the preferred 

65 embodiment presents a mechanism for sorting messages 
according to priority (including class status). Messages can 
be assigned priority based on previous deferral, and also 
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based on intended destinations, such as a particular web site. 
Multiple functions of a host computer can also be 
prioritized, either on an absolute basis, or based on a 
determination that a particular class of functions have 
exceeded allocated resources. 

In view of the foregoing description, various alternative 
embodiments of the present invention will occur to those 
having skill in electronics. For example, various software 
alternatives will also occur to those having programming 
skill which effects deferral of messages without departing 
from the spirit of the present invention. The admission 
control gateway, deferral manager and scheduler, above, are 
typically implemented with a single set of code having 
various arrangements of routines and subroutines, but some 
of these functions could also be implemented in hardware or 
firmware. Other mechanisms for assisting admission control 
on either the server side or the client side may be used 
instead of the mechanisms described above. 

Having thus described several exemplary implementa- 
tions of the invention, it will be apparent that various 
alterations, modifications, and improvements will readily 
occur to those skilled in the art. Such alterations, 
modifications, and improvements, though not expressly 
described above, are nonetheless intended and implied to be 
within the spirit and scope of the invention. Accordingly, the 
foregoing discussion is intended to be illustrative only; the 
invention is limited and defined only by the following claims 
and equivalents thereto. 

What is claimed is: 

1. A host processing system that processes message from 
a stream of messages according to class status, comprising: 

a server; and 

an admission control gateway that 

receives the stream of messages, 

determines from an indicator associated with each 
message whether messages from the stream have 
been assigned priority status relative to other mes- 
sages from the stream, and 

discriminates between messages in the stream having 
relatively higher priority at the expense of other 
messages in the stream; 
wherein the admission control gateway selectively rejects 

messages in the stream having relatively low priority, 

and does not pass such rejected messages to a server. 

2. A host processing system according to claim 1, 
wherein: 

said host processing system further comprises a resource 
monitor, which monitors server processing resources 
and provides an indication thereof; and 

the admission control gateway, in response to an indica- 
tion from the resource monitor that processing 
resources available to the server are scarce, rejects 
messages not corresponding to a session in-progress 
and not having a priority status relative to other mes- 
sages. 

3. A host processing system according to claim 1, 
wherein: 

said host processing system further comprises a message 
queue; and 

the admission control gateway sorts messages according 
to priority and re-orders messages in the message 
queue, such that messages having an associated priority 
which is relatively higher than other messages in the 
stream are processed first. 
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4. A host processing system according to claim 1, 
wherein: 

at least one message in the stream includes as transmitted 
from a client system an indicator which has been 
previously assigned by said host processing system, 
and the admission control gateway filters the indicator 
from the at least one message and uses the indicator to 
determine priority. 

5. Ahost processing system according to claim 1, wherein 
the admission control gateway: 

uses the indicator to distinguish a new, low-priority ses- 
sion represented by a message from sessions 
in-progress and new, high-priority sessions; 

determines whether a server has sufficient processing 
resources to process the new, low-priority session; and 

rejects in response to a negative determination the new, 
low-priority session. 

6. A host processing system including admission control 
that selectively admits a messages in a stream of messages 
originating from at least one client system to a host, com- 
prising: 

a resource monitor coupled to the host that measures 
processing resources of the host, the resource monitor 
providing an indication of processing resources avail- 
able to the host; and 
an admission control gateway that receives both the 
stream of messages and the indication from the 
resource monitor, the admission control gateway 
determining whether each message in the stream cor- 
responds to a session in-progress and, if a message 
corresponds to a session in-progress, responsively 
admitting the message to the host, and 
determining whether messages from the stream not 
corresponding to a session in-progress have been 
assigned priority status relative to other messages 
and, admitting messages which do have a corre- 
sponding priority status as new sessions; 
wherein the admission control gateway, in response to an 
indication from the resource monitor that processing 
resources available to the host are scarce, rejects mes- 
sages not corresponding to a session in-progress and 
not having a priority status relative to other messages. 

7. Ahost processing system according to claim 6, wherein 
the host processing system includes at least one server. 

8. Ahost processing system according to claim 6, wherein 
the host processing system supports two web sites, each web 
site having a different associated level of service, and 
wherein: 

the admission control gateway, in response to an indica- 
tion from the resource monitor that processing 
resources available to the host are scarce, rejects new 
sessions represented by messages corresponding to the 
second web site but admits new sessions represented by 
messages corresponding to the first web site. 

9. A host processing system according to claim 6, further 
comprising means for determining, for each message which 
has an indication of priority relative to other messages, 
whether sufficient resources of the host processor are avail- 
able for processing of a new session, and if insufficient 
resources of the host processor are available, for also inter- 
rupting and deferring a session of lower priority in-progress 
to make room for a session of higher priority. 

10. A host processing system according to claim 6, 
wherein said host processing system provides at least three 
classes of service including at least two levels of priority in 
processing for a single web site. 
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11. A host processing system including admission control 
that selectively admits a messages in a stream of messages 
originating from at least one client system to a host, com- 
prising: 

a resource monitor coupled to the host that measures 
processing resources of the host, the resource monitor 
providing an indication of processing resources avail- 
able to the host; and 
an admission control gateway that receives both the 
stream of messages and the indication from the 
resource monitor, the admission control gateway 
determining whether each message in the stream cor- 
responds to a session in-progress and, if a message 
corresponds to a session in-progress, responsively 
admitting the message to the host, and 
determining whether messages from the stream not 
corresponding to a session in-progress have been 
assigned priority status relative to other messages as 
indicated by one of a cookie, a password, or a value 
from the list maintained by the admission control 20 
gateway, and, admitting messages which do have a 
corresponding priority status as new sessions; 
a deferral manager that receives messages which have 
been rejected by the admission control gateway and 
that responsively determines a time when deferred 
messages can be processed by the host processing 
system; 
wherein 

the admission control gateway, in response to an indi- 
cation from the resource monitor that processing 
resources available to the host are scarce, rejects 
messages not corresponding to a session in-progress 
and not having a priority status relative to other 
messages, and, 

the deferral manager formats a deferral message sent to 
a client system to including an indication of the time, 
and stores a priority indicator corresponding to the 
deferral message for use by the admission control 
gateway upon a later re -submission of a rejected 
message, the priority indicator including at least one 
of a cookie stored on the client system, a password 
sent to the client system, and a list maintained by the 
admission control gateway. 

12. A host processing system according to claim 11, 
wherein the deferral message is adapted to cause the client 
system to re-send a message to the host processor at the time 
when the deferred message can be processed by the host 
processing system. 

13. A host processing system according to claim 12, 
wherein the deferral message includes a web page having a 
countdown time, the web page adapted to cause a browser 
of the client system to re-send a message to the host 
processor at the time when the deferred message can be 
processed by the host processing system. 

14. An improvement in a host processing system that 
selectively admits incoming messages sent from a client 
system, the host processing system including at least one of 
software, firmware and hardware that effect admission con- 
trol for a server, said improvement comprising: 

determining whether incoming messages correspond to a 
session in-progress and admitting to the server those 
incoming messages which do correspond to a session 
in-progress; 

for incoming messages not corresponding to a session 
in-progress, comparing current server processing 
resources with at least one predetermined parameter 
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and responsively determining whether a session corre- 
sponding to the message can be processed without 
burdening server processing resources beyond an 
amount indicated by a predetermined parameter; 
for incoming messages not corresponding to a session 
in-progress, 

determining whether the message has been assigned 

priority by said host processing system, and 
if the message has been assigned priority by said host 
processing system, then admitting the message as a 
new session; and 
deferring incoming messages which do not correspond to 
a session in-progress, have not been assigned priority 
by said host processing system and cannot be otherwise 
processed without burdening server resources beyond 
the amount indicated by a predetermined parameter. 

15. An improvement according to claim 14, further com- 
prising: 

determining, with respect to a particular message having 
been assigned priority, whether sufficient processing 
resources are available to process a new session; 

if sufficient processing resources are not available to 
process a new session, then determining whether pro- 
cessing resources are used by a session in-progress 
which has less priority than the particular message; and 

if processing resources are used by a session in-progress 
having less priority, interrupting such session and 
beginning a new session represented by the particular 
message. 

16. An improvement according to claim 15, further com- 
prising: 

if processing resources are not used by a session 
in-progress having less priority, further increasing an 
indication of priority of the particular message, such 
that upon later re-submission of the particular message, 
an associated indication of priority will be relatively 
higher. 

17. An improvement according to claim 16, further com- 
prising: 

for messages not admitted to the host processing system, 
inhibiting acceptance upon re-submission for at least a 
predetermined period of time. 

18. An improvement in a host processing system that 
selectively admits incoming messages sent from a client 
system, the host processing system including at least one of 
software, firmware and hardware that effect admission con- 
trol for a server, said improvement comprising: 

determining whether incoming messages correspond to a 
session in-progress and admitting to the server those 
incoming messages which do correspond to a session 
in-progress; 

for incoming messages not corresponding to a session 
in-progress, comparing current server processing 
resources with at least one predetermined parameter 
and responsively determining whether a session corre- 
sponding to the message can be processed without 
burdening server processing resources beyond an 
amount indicated by a predetermined parameter; 

for incoming messages not corresponding to a session 
in-progress, 

determining whether the message has been assigned 
priority by said host processing system, and 

if the message has been assigned priority by said host 
processing system, then admitting the message as a 
new session; and 
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deferring incoming messages which do not correspond 
to a session in -progress, have not been assigned 
priority by said host processing system and cannot be 
otherwise processed without burdening server 
resources beyond the amount indicated by a prede- 5 
termined parameter; 
wherein deferring includes 

assigning a time indicator to those messages which 
are deferred for later admission to the server on a 
priority basis, and transmitting an indication of 10 
deferral and the time indicator to a client system 
which originally sent a corresponding deferred 
message; and 



creating a priority indicator associated with deferred 
messages of prior deferral by said host processing 
system, the priority indicator adapted for use by 
said admission control gateway in determining 
whether a corresponding message has been 
assigned priority (previously by said admission 
control gateway). 
19. An improvement according to claim 18, further com- 
prising: 

automatically causing a client system to re-submit a 
deferred message to a host at substantially the later 
time. 
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